Instructions:
Start here if this is your first time using dplyr. You’ll learn the
basic philosophy, the most important data manipulation
verbs, and the pipe, %>%, which allows
you to combine multiple verbs together to solve real problems.
Read the text and execute each chunk as you go along. If you make any
discoveries or have questions, put them into the text immediately after
the chunk/text where your doubt is created. I have put in small
instructions here and there for you to prompt your thinking and
connection-making.
When working with data you must:
The dplyr package makes these steps fast and easy:
By constraining your options, it helps you think about your data
manipulation challenges.
It provides simple “verbs”, functions that
correspond to the most common data manipulation tasks, to help you
translate your thoughts into code.
It uses efficient backends, so you spend less time waiting for
the computer.
Ne’er you mind about backends ;-) See Shakespeare’s Hamlet.
This document introduces you to dplyr’s basic set of tools, and shows
you how to apply them to data frames. dplyr also supports
databases via the dbplyr package, once you’ve installed,
read vignette("dbplyr") to learn more.
Data: starwars
To explore the basic data manipulation verbs of dplyr,
we’ll use the dataset starwars. This dataset contains 87
characters and comes from the Star Wars
API, and is documented in ?starwars
This means: type ?starwars in the Console. Try.
dim(starwars)
#> [1] 87 14
starwars
Note that starwars is a tibble, a modern
reimagining of the data frame. It’s particularly useful for large
datasets because it only prints the first few rows. You can learn more
about tibbles at https://tibble.tidyverse.org; in particular you can
convert data frames to tibbles with as_tibble().
Check your Environment Tab to inspect starwars in a
separate tab.
Single table
verbs
dplyr aims to provide a function for each basic verb of
data manipulation. These verbs can be organised into three categories
based on the component of the dataset that they work with:
- Rows:
filter() chooses rows based on column values.
slice() chooses rows based on location.
arrange() changes the order of the rows.
- Columns:
select() changes whether or not a column is
included.
rename() changes the name of columns.
mutate() changes the values of columns and creates new
columns.
relocate() changes the order of the columns.
- Groups of rows:
summarise() collapses a group into a single row.
Think of the parallels from Microsoft Excel.
The pipe
All of the dplyr functions take a data frame (or
tibble) as the first argument. Rather than forcing the user
to either save intermediate objects or nest functions, dplyr provides
the %>% operator from magrittr.
x %>% f(y) turns into f(x, y) so the result
from one step is then “piped” into the next step. You can use the pipe
to rewrite multiple operations that you can read left-to-right,
top-to-bottom (reading the pipe operator as
“then”).
Filter rows with
filter()
filter() allows you to select a subset of rows in a data
frame. Like all single verbs, the first argument is the tibble (or data
frame). The second and subsequent arguments refer to variables within
that data frame, selecting rows where the expression is
TRUE.
For example, we can select all character with light skin color and
brown eyes with:
Note the double equal to sign (==) below! Equivalent to MS Excel Data
-> Filter
starwars %>% filter(skin_color == "light", eye_color == "brown")
Arrange rows with
arrange()
arrange() works similarly to filter()
except that instead of filtering or selecting rows, it
reorders them. It takes a data frame, and a set of
column names (or more complicated expressions) to order by. If you
provide more than one column name, each additional column will be used
to break ties in the values of preceding columns:
starwars %>% arrange(height, mass)
Use desc() to order a column in descending order:
starwars %>% arrange(desc(height))
Choose rows using
their position with slice()
slice() lets you index rows by their (integer)
locations. It allows you to select, remove, and duplicate rows.
This is an important step in Prediction, Modelling and Machine
Learning.
We can get characters from row numbers 5 through 10.
starwars %>% slice(5:10)
It is accompanied by a number of helpers for common use cases:
slice_head() and slice_tail() select the
first or last rows.
starwars %>% slice_head(n = 3)
slice_sample() randomly selects rows. Use the option
prop to choose a certain proportion of the cases.
starwars %>% slice_sample(n = 5)
starwars %>% slice_sample(prop = 0.1)
Use replace = TRUE to perform a bootstrap sample. If
needed, you can weight the sample with the weight
argument.
Bootstrap samples are a special statistical sampling
method. Counterintuitive perhaps, since you sample with replacement.
Should remind you of your high school Permutation and Combination class,
with all those urn models and so on. If you remember.
slice_min() and slice_max() select rows
with highest or lowest values of a variable. Note that we first must
choose only the values which are not NA.
starwars %>%
filter(!is.na(height)) %>%
slice_min(height, n = 3)
Select columns with
select()
Often you work with large datasets with many columns but only a few
are actually of interest to you. select() allows you to
rapidly zoom in on a useful subset using operations that usually only
work on numeric variable positions:
# Select columns by name
starwars %>% select(hair_color, skin_color, eye_color)
# Select all columns between hair_color and eye_color (inclusive)
starwars %>% select(hair_color:eye_color)
# Select all columns except those from hair_color to eye_color (inclusive)
starwars %>% select(!(hair_color:eye_color))
# Select all columns ending with color
starwars %>% select(ends_with("color"))
There are a number of helper functions you can use within
select(), like starts_with(),
ends_with(), matches() and
contains(). These let you quickly match larger blocks of
variables that meet some criterion. See ?select for more
details.
You can rename variables with select() by using named
arguments:
starwars %>% select(home_world = homeworld)
But because select() drops all the variables not
explicitly mentioned, it’s not that useful. Instead, use
rename():
starwars %>% rename(home_world = homeworld)
Add new columns
with mutate()
Besides selecting sets of existing columns, it’s often useful to add
new columns that are functions of existing columns. This is the job of
mutate():
starwars %>% mutate(height_m = height / 100)
We can’t see the height in meters we just calculated, but we can fix
that using a select command.
starwars %>%
mutate(height_m = height / 100) %>%
select(height_m, height, everything())
dplyr::mutate() is similar to the base
transform(), but allows you to refer to columns that you’ve
just created:
starwars %>%
mutate(
height_m = height / 100,
BMI = mass / (height_m^2)
) %>%
select(BMI, everything())
If you only want to keep the new variables, use
transmute():
starwars %>%
transmute(
height_m = height / 100,
BMI = mass / (height_m^2)
)
Change column order
with relocate()
Use a similar syntax as select() to move blocks of
columns at once
starwars %>% relocate(sex:homeworld, .before = height)
Summarise values
with summarise()
The last verb is summarise(). It collapses a data frame
to a single row.
starwars %>% summarise(mean_height = mean(height, na.rm = TRUE))
It’s not that useful until we learn the group_by() verb
below.
Commonalities
You may have noticed that the syntax and function of all these verbs
are very similar:
The first argument is a data frame.
The subsequent arguments describe what to do with the data frame.
You can refer to columns in the data frame directly without using
$.
The result is a new data frame
Together these properties make it easy to chain together multiple
simple steps to achieve a complex result.
These five functions provide the basis of a language of data
manipulation. At the most basic level, you can only alter a tidy data
frame in five useful ways: you can reorder the rows
(arrange()), pick observations and variables of interest
(filter() and select()), add new variables
that are functions of existing variables (mutate()), or
collapse many values to a summary (summarise()).
Combining functions
with %>%
The dplyr API is functional in the sense that function calls don’t
have side-effects. You must always save their results. This doesn’t lead
to particularly elegant code, especially if you want to do many
operations at once. You either have to do it step-by-step:
a1 <- group_by(starwars, species, sex)
a2 <- select(a1, height, mass)
a3 <- summarise(a2,
height = mean(height, na.rm = TRUE),
mass = mean(mass, na.rm = TRUE)
)
Or if you don’t want to name the intermediate results, you need to
wrap the function calls inside each other:
summarise(
select(
group_by(starwars, species, sex),
height, mass
),
height = mean(height, na.rm = TRUE),
mass = mean(mass, na.rm = TRUE)
)
#> Adding missing grouping variables: `species`, `sex`
#> `summarise()` has grouped output by 'species'. You can override using the `.groups` argument.
This is difficult to read because the order of the operations is from
inside to out. Thus, the arguments are a long way away from the
function. To get around this problem, dplyr provides the
%>% operator from magrittr. x %>% f(y)
turns into f(x, y) so you can use it to rewrite multiple
operations that you can read left-to-right, top-to-bottom (reading the
pipe operator as “then”):
starwars %>%
group_by(species, sex) %>%
summarise(
mean_height = mean(height, na.rm = TRUE),
mean_mass = mean(mass, na.rm = TRUE)
)
#> `summarise()` has grouped output by 'species'. You can override using the `.groups` argument.
Patterns of
operations
The dplyr verbs can be classified by the type of operations they
accomplish (we sometimes speak of their semantics,
i.e., their meaning). It’s helpful to have a good grasp of the
difference between select and mutate operations.
Selecting
operations
One of the appealing features of dplyr is that you can refer to
columns from the tibble as if they were regular variables. However, the
syntactic uniformity of referring to bare column names hides semantical
differences across the verbs. A column symbol supplied to
select() does not have the same meaning as the same symbol
supplied to mutate().
Selecting operations expect column names and positions. Hence, when
you call select() with bare variable names, they actually
represent their own positions in the tibble. The following calls are
completely equivalent from dplyr’s point of view:
# `name` represents the integer 1
select(starwars, name)
select(starwars, 1)
By the same token, this means that you cannot refer to variables from
the surrounding context if they have the same name as one of the
columns. In the following example, height still represents
2, not 5:
height <- 5
select(starwars, height)
One useful subtlety is that this only applies to bare names and to
selecting calls like c(height, mass) or
height:mass. In all other cases, the columns of the data
frame are not put in scope. This allows you to refer to contextual
variables in selection helpers:
name <- "color"
select(starwars, ends_with(name))
These semantics are usually intuitive. But note the subtle
difference:
name <- 5
select(starwars, name, identity(name))
In the first argument, name represents its own position
1. In the second argument, name is evaluated
in the surrounding context and represents the fifth column.
Mutating
operations
Mutate semantics are quite different from selection semantics.
Whereas select() expects column names or positions,
mutate() expects column vectors. We will set up a
smaller tibble to use for our examples.
df <- starwars %>% select(name, height, mass)
When we use select(), the bare column names stand for
their own positions in the tibble. For mutate() on the
other hand, column symbols represent the actual column vectors stored in
the tibble. Consider what happens if we give a string or a number to
mutate():
mutate(df, "height", 2)
mutate() gets length-1 vectors that it interprets as new
columns in the data frame. These vectors are recycled so they match the
number of rows. That’s why it doesn’t make sense to supply expressions
like "height" + 10 to mutate(). This amounts
to adding 10 to a string! The correct expression is:
mutate(df, height + 10)
In the same way, you can unquote values from the context if these
values represent a valid column. They must be either length 1 (they then
get recycled) or have the same length as the number of rows. In the
following example we create a new vector that we add to the data
frame:
var <- seq(1, nrow(df))
mutate(df, new = var)
A case in point is group_by(). While you might think it
has select semantics, it actually has mutate
semantics. This is quite handy as it allows to group by a modified
column:
group_by(starwars, sex)
group_by(starwars, sex = as.factor(sex))
group_by(starwars, height_binned = cut(height, 3))
This is why you can’t supply a column name to
group_by(). This amounts to creating a new column
containing the string recycled to the number of rows:
group_by(df, "month")
LS0tDQp0aXRsZTogIk15IEludHJvZHVjdGlvbiB0byB0aGUgZHBseXIgcGFja2FnZSINCmF1dGhvcjogIkFydmluZCBWZW5rYXRhZHJpIg0KZGF0ZTogMDYvSnVseS8yMDIxDQpvdXRwdXQ6DQogIGh0bWxfZG9jdW1lbnQ6DQogICAgdGhlbWU6IGZsYXRseQ0KICAgIHRvYzogVFJVRQ0KICAgIHRvY19mbG9hdDogVFJVRQ0KICAgIHRvY19kZXB0aDogMg0KICAgIGRmX3ByaW50OiBwYWdlZA0KICAgIG51bWJlcl9zZWN0aW9uczogVFJVRQ0KICAgIGNvZGVfZm9sZGluZzogaGlkZQ0KICAgIGNvZGVfZG93bmxvYWQ6IFRSVUUNCg0KLS0tDQojIyBJbnN0cnVjdGlvbnM6DQoNClN0YXJ0IGhlcmUgaWYgdGhpcyBpcyB5b3VyIGZpcnN0IHRpbWUgdXNpbmcgZHBseXIuIFlvdSdsbCBsZWFybiB0aGUgYmFzaWMgcGhpbG9zb3BoeSwgdGhlIG1vc3QgaW1wb3J0YW50IGRhdGEgbWFuaXB1bGF0aW9uICoqdmVyYnMqKiwgYW5kIHRoZSBwaXBlLCBgJT4lYCwgd2hpY2ggYWxsb3dzIHlvdSB0byBjb21iaW5lIG11bHRpcGxlIHZlcmJzIHRvZ2V0aGVyIHRvIHNvbHZlIHJlYWwgcHJvYmxlbXMuDQoNClJlYWQgdGhlIHRleHQgYW5kIGV4ZWN1dGUgZWFjaCBjaHVuayBhcyB5b3UgZ28gYWxvbmcuIElmIHlvdSBtYWtlIGFueSBkaXNjb3ZlcmllcyBvciBoYXZlIHF1ZXN0aW9ucywgcHV0IHRoZW0gaW50byB0aGUgdGV4dCBpbW1lZGlhdGVseSBhZnRlciB0aGUgY2h1bmsvdGV4dCB3aGVyZSB5b3VyIGRvdWJ0IGlzIGNyZWF0ZWQuIEkgaGF2ZSBwdXQgaW4gc21hbGwgaW5zdHJ1Y3Rpb25zIGhlcmUgYW5kIHRoZXJlIGZvciB5b3UgdG8gcHJvbXB0IHlvdXIgdGhpbmtpbmcgYW5kIGNvbm5lY3Rpb24tbWFraW5nLg0KDQpgYGB7ciwgZWNobyA9IEZBTFNFLCBtZXNzYWdlID0gRkFMU0V9DQprbml0cjo6b3B0c19jaHVuayRzZXQoY29sbGFwc2UgPSBULCBjb21tZW50ID0gIiM+IikNCm9wdGlvbnModGliYmxlLnByaW50X21pbiA9IDRMLCB0aWJibGUucHJpbnRfbWF4ID0gNEwpDQpsaWJyYXJ5KHRpZHl2ZXJzZSkNCnNldC5zZWVkKDEwMTQpDQoNCiNkZXZ0b29sczo6aW5zdGFsbF9naXRodWIoImdhZGVuYnVpZS90aWR5LWFuaW1hdGVkLXZlcmJzIikNCg0KYGBgDQoNCldoZW4gd29ya2luZyB3aXRoIGRhdGEgeW91IG11c3Q6DQoNCiogRmlndXJlIG91dCB3aGF0IHlvdSB3YW50IHRvIGRvLg0KDQoqIERlc2NyaWJlIHRob3NlIHRhc2tzIGluIHRoZSBmb3JtIG9mIGEgY29tcHV0ZXIgcHJvZ3JhbS4NCg0KKiBFeGVjdXRlIHRoZSBwcm9ncmFtLg0KDQpUaGUgYGRwbHlyYCBwYWNrYWdlIG1ha2VzIHRoZXNlIHN0ZXBzIGZhc3QgYW5kIGVhc3k6DQoNCiogQnkgY29uc3RyYWluaW5nIHlvdXIgb3B0aW9ucywgaXQgaGVscHMgeW91IHRoaW5rIGFib3V0IHlvdXIgZGF0YSBtYW5pcHVsYXRpb24gY2hhbGxlbmdlcy4NCg0KKiBJdCBwcm92aWRlcyBzaW1wbGUgKioidmVyYnMiKiosIGZ1bmN0aW9ucyB0aGF0IGNvcnJlc3BvbmQgdG8gdGhlIG1vc3QgY29tbW9uIGRhdGEgbWFuaXB1bGF0aW9uIHRhc2tzLCB0byBoZWxwIHlvdSB0cmFuc2xhdGUgeW91ciB0aG91Z2h0cyBpbnRvIGNvZGUuDQoNCiogSXQgdXNlcyBlZmZpY2llbnQgYmFja2VuZHMsIHNvIHlvdSBzcGVuZCBsZXNzIHRpbWUgd2FpdGluZyBmb3IgdGhlIGNvbXB1dGVyLiANCg0KICAgICAgICAgICAgDQo+IE5lJ2VyIHlvdSBtaW5kIGFib3V0IGJhY2tlbmRzIDstKSBTZWUgU2hha2VzcGVhcmUncyAqW0hhbWxldC5dKGh0dHBzOi8vd3d3Lmdvb2RyZWFkcy5jb20vcXVvdGVzLzM5MjgxOC10aGVyZS1zLWEtZGl2aW5pdHktdGhhdC1zaGFwZXMtb3VyLWVuZHMtcm91Z2gtaGV3LXRoZW0taG93KSoNCg0KVGhpcyBkb2N1bWVudCBpbnRyb2R1Y2VzIHlvdSB0byBkcGx5cidzIGJhc2ljIHNldCBvZiB0b29scywgYW5kIHNob3dzIHlvdSBob3cgdG8gYXBwbHkgdGhlbSB0byBkYXRhIGZyYW1lcy4gYGRwbHlyYCBhbHNvIHN1cHBvcnRzIGRhdGFiYXNlcyB2aWEgdGhlIGBkYnBseXJgIHBhY2thZ2UsIG9uY2UgeW91J3ZlIGluc3RhbGxlZCwgcmVhZCBgdmlnbmV0dGUoImRicGx5ciIpYCB0byBsZWFybiBtb3JlLg0KDQojIyBEYXRhOiBzdGFyd2Fycw0KDQpUbyBleHBsb3JlIHRoZSBiYXNpYyBkYXRhIG1hbmlwdWxhdGlvbiB2ZXJicyBvZiBgZHBseXJgLCB3ZSdsbCB1c2UgdGhlIGRhdGFzZXQgYHN0YXJ3YXJzYC4gVGhpcyBkYXRhc2V0IGNvbnRhaW5zIGByIG5yb3coc3RhcndhcnMpYCBjaGFyYWN0ZXJzIGFuZCBjb21lcyBmcm9tIHRoZSBbU3RhciBXYXJzIEFQSV0oaHR0cHM6Ly9zd2FwaS5kZXYpLCBhbmQgaXMgZG9jdW1lbnRlZCBpbiBgP3N0YXJ3YXJzYCANCg0KPiBUaGlzIG1lYW5zOiB0eXBlIGA/c3RhcndhcnNgIGluIHRoZSBDb25zb2xlLiBUcnkuDQoNCmBgYHtyfQ0KZGltKHN0YXJ3YXJzKQ0Kc3RhcndhcnMNCmBgYA0KDQpOb3RlIHRoYXQgYHN0YXJ3YXJzYCBpcyBhIGB0aWJibGVgLCBhIG1vZGVybiByZWltYWdpbmluZyBvZiB0aGUgZGF0YSBmcmFtZS4gSXQncyBwYXJ0aWN1bGFybHkgdXNlZnVsIGZvciBsYXJnZSBkYXRhc2V0cyBiZWNhdXNlIGl0IG9ubHkgcHJpbnRzIHRoZSBmaXJzdCBmZXcgcm93cy4gWW91IGNhbiBsZWFybiBtb3JlIGFib3V0IHRpYmJsZXMgYXQgPGh0dHBzOi8vdGliYmxlLnRpZHl2ZXJzZS5vcmc+OyBpbiBwYXJ0aWN1bGFyIHlvdSBjYW4gY29udmVydCBkYXRhIGZyYW1lcyB0byB0aWJibGVzIHdpdGggYGFzX3RpYmJsZSgpYC4NCg0KPiBDaGVjayB5b3VyIEVudmlyb25tZW50IFRhYiB0byBpbnNwZWN0IGBzdGFyd2Fyc2AgaW4gYSBzZXBhcmF0ZSB0YWIuDQoNCiMjIFNpbmdsZSB0YWJsZSB2ZXJicw0KDQpgZHBseXJgIGFpbXMgdG8gcHJvdmlkZSBhIGZ1bmN0aW9uIGZvciBlYWNoIGJhc2ljIHZlcmIgb2YgZGF0YSBtYW5pcHVsYXRpb24uIFRoZXNlIHZlcmJzIGNhbiBiZSBvcmdhbmlzZWQgaW50byB0aHJlZSBjYXRlZ29yaWVzIGJhc2VkIG9uIHRoZSBjb21wb25lbnQgb2YgdGhlIGRhdGFzZXQgdGhhdCB0aGV5IHdvcmsgd2l0aDoNCg0KKiBSb3dzOg0KICAqIGBmaWx0ZXIoKWAgY2hvb3NlcyByb3dzIGJhc2VkIG9uIGNvbHVtbiB2YWx1ZXMuDQogICogYHNsaWNlKClgIGNob29zZXMgcm93cyBiYXNlZCBvbiBsb2NhdGlvbi4NCiAgKiBgYXJyYW5nZSgpYCBjaGFuZ2VzIHRoZSBvcmRlciBvZiB0aGUgcm93cy4NCiAgDQoqIENvbHVtbnM6DQogICogYHNlbGVjdCgpYCBjaGFuZ2VzIHdoZXRoZXIgb3Igbm90IGEgY29sdW1uIGlzIGluY2x1ZGVkLg0KICAqIGByZW5hbWUoKWAgY2hhbmdlcyB0aGUgbmFtZSBvZiBjb2x1bW5zLg0KICAqIGBtdXRhdGUoKWAgY2hhbmdlcyB0aGUgdmFsdWVzIG9mIGNvbHVtbnMgYW5kIGNyZWF0ZXMgbmV3IGNvbHVtbnMuDQogICogYHJlbG9jYXRlKClgIGNoYW5nZXMgdGhlIG9yZGVyIG9mIHRoZSBjb2x1bW5zLg0KDQoqIEdyb3VwcyBvZiByb3dzOg0KICAqIGBzdW1tYXJpc2UoKWAgY29sbGFwc2VzIGEgZ3JvdXAgaW50byBhIHNpbmdsZSByb3cuDQoNCj4gVGhpbmsgb2YgdGhlIHBhcmFsbGVscyBmcm9tIE1pY3Jvc29mdCBFeGNlbC4gDQoNCg0KIyMjIFRoZSBwaXBlDQoNCkFsbCBvZiB0aGUgYGRwbHlyYCBmdW5jdGlvbnMgdGFrZSBhIGRhdGEgZnJhbWUgKG9yIGB0aWJibGVgKSBhcyB0aGUgZmlyc3QgYXJndW1lbnQuIFJhdGhlciB0aGFuIGZvcmNpbmcgdGhlIHVzZXIgdG8gZWl0aGVyIHNhdmUgaW50ZXJtZWRpYXRlIG9iamVjdHMgb3IgbmVzdCBmdW5jdGlvbnMsIGRwbHlyIHByb3ZpZGVzIHRoZSBgJT4lYCBvcGVyYXRvciBmcm9tIGBtYWdyaXR0cmAuIGB4ICU+JSBmKHkpYCB0dXJucyBpbnRvIGBmKHgsIHkpYCBzbyB0aGUgcmVzdWx0IGZyb20gb25lIHN0ZXAgaXMgdGhlbiAicGlwZWQiIGludG8gdGhlIG5leHQgc3RlcC4gWW91IGNhbiB1c2UgdGhlIHBpcGUgdG8gcmV3cml0ZSBtdWx0aXBsZSBvcGVyYXRpb25zIHRoYXQgeW91IGNhbiByZWFkIGxlZnQtdG8tcmlnaHQsIHRvcC10by1ib3R0b20gKCoqcmVhZGluZyB0aGUgcGlwZSBvcGVyYXRvciBhcyAidGhlbiIqKikuIA0KDQojIyMgRmlsdGVyIHJvd3Mgd2l0aCBgZmlsdGVyKClgDQoNCmBmaWx0ZXIoKWAgYWxsb3dzIHlvdSB0byBzZWxlY3QgYSBzdWJzZXQgb2Ygcm93cyBpbiBhIGRhdGEgZnJhbWUuIExpa2UgYWxsIHNpbmdsZSB2ZXJicywgdGhlIGZpcnN0IGFyZ3VtZW50IGlzIHRoZSB0aWJibGUgKG9yIGRhdGEgZnJhbWUpLiBUaGUgc2Vjb25kIGFuZCBzdWJzZXF1ZW50IGFyZ3VtZW50cyByZWZlciB0byB2YXJpYWJsZXMgd2l0aGluIHRoYXQgZGF0YSBmcmFtZSwgc2VsZWN0aW5nIHJvd3Mgd2hlcmUgdGhlIGV4cHJlc3Npb24gaXMgYFRSVUVgLg0KDQpGb3IgZXhhbXBsZSwgd2UgY2FuIHNlbGVjdCBhbGwgY2hhcmFjdGVyIHdpdGggbGlnaHQgc2tpbiBjb2xvciBhbmQgYnJvd24gZXllcyB3aXRoOg0KDQo+IE5vdGUgdGhlIGRvdWJsZSBlcXVhbCB0byBzaWduICg9PSkgYmVsb3chIEVxdWl2YWxlbnQgdG8gTVMgRXhjZWwgRGF0YSAtPiBGaWx0ZXINCg0KYGBge3J9DQpzdGFyd2FycyAlPiUgZmlsdGVyKHNraW5fY29sb3IgPT0gImxpZ2h0IiwgZXllX2NvbG9yID09ICJicm93biIpDQpgYGANCg0KDQojIyMgQXJyYW5nZSByb3dzIHdpdGggYGFycmFuZ2UoKWANCg0KYGFycmFuZ2UoKWAgd29ya3Mgc2ltaWxhcmx5IHRvIGBmaWx0ZXIoKWAgZXhjZXB0IHRoYXQgaW5zdGVhZCBvZiBmaWx0ZXJpbmcgb3Igc2VsZWN0aW5nIHJvd3MsIGl0ICoqcmVvcmRlcnMqKiB0aGVtLiBJdCB0YWtlcyBhIGRhdGEgZnJhbWUsIGFuZCBhIHNldCBvZiBjb2x1bW4gbmFtZXMgKG9yIG1vcmUgY29tcGxpY2F0ZWQgZXhwcmVzc2lvbnMpIHRvIG9yZGVyIGJ5LiBJZiB5b3UgcHJvdmlkZSBtb3JlIHRoYW4gb25lIGNvbHVtbiBuYW1lLCBlYWNoIGFkZGl0aW9uYWwgY29sdW1uIHdpbGwgYmUgdXNlZCB0byBicmVhayB0aWVzIGluIHRoZSB2YWx1ZXMgb2YgcHJlY2VkaW5nIGNvbHVtbnM6DQoNCmBgYHtyfQ0Kc3RhcndhcnMgJT4lIGFycmFuZ2UoaGVpZ2h0LCBtYXNzKQ0KYGBgDQoNClVzZSBgZGVzYygpYCB0byBvcmRlciBhIGNvbHVtbiBpbiBkZXNjZW5kaW5nIG9yZGVyOg0KDQpgYGB7cn0NCnN0YXJ3YXJzICU+JSBhcnJhbmdlKGRlc2MoaGVpZ2h0KSkNCmBgYA0KDQojIyMgIENob29zZSByb3dzIHVzaW5nIHRoZWlyIHBvc2l0aW9uIHdpdGggYHNsaWNlKClgDQoNCmBzbGljZSgpYCBsZXRzIHlvdSBpbmRleCByb3dzIGJ5IHRoZWlyIChpbnRlZ2VyKSBsb2NhdGlvbnMuIEl0IGFsbG93cyB5b3UgdG8gc2VsZWN0LCByZW1vdmUsIGFuZCBkdXBsaWNhdGUgcm93cy4gDQoNCj5UaGlzIGlzIGFuIGltcG9ydGFudCBzdGVwIGluIFByZWRpY3Rpb24sIE1vZGVsbGluZyBhbmQgTWFjaGluZSBMZWFybmluZy4gDQoNCldlIGNhbiBnZXQgY2hhcmFjdGVycyBmcm9tIHJvdyBudW1iZXJzIDUgdGhyb3VnaCAxMC4NCmBgYHtyfQ0Kc3RhcndhcnMgJT4lIHNsaWNlKDU6MTApDQpgYGANCg0KSXQgaXMgYWNjb21wYW5pZWQgYnkgYSBudW1iZXIgb2YgaGVscGVycyBmb3IgY29tbW9uIHVzZSBjYXNlczoNCg0KKiBgc2xpY2VfaGVhZCgpYCBhbmQgYHNsaWNlX3RhaWwoKWAgc2VsZWN0IHRoZSBmaXJzdCBvciBsYXN0IHJvd3MuDQoNCmBgYHtyfQ0Kc3RhcndhcnMgJT4lIHNsaWNlX2hlYWQobiA9IDMpDQpgYGANCg0KKiBgc2xpY2Vfc2FtcGxlKClgIHJhbmRvbWx5IHNlbGVjdHMgcm93cy4gVXNlIHRoZSBvcHRpb24gcHJvcCB0byBjaG9vc2UgYSBjZXJ0YWluIHByb3BvcnRpb24gb2YgdGhlIGNhc2VzLg0KDQpgYGB7cn0NCnN0YXJ3YXJzICU+JSBzbGljZV9zYW1wbGUobiA9IDUpDQpzdGFyd2FycyAlPiUgc2xpY2Vfc2FtcGxlKHByb3AgPSAwLjEpDQpgYGANCg0KVXNlIGByZXBsYWNlID0gVFJVRWAgdG8gcGVyZm9ybSBhIGJvb3RzdHJhcCBzYW1wbGUuIElmIG5lZWRlZCwgeW91IGNhbiB3ZWlnaHQgdGhlIHNhbXBsZSB3aXRoIHRoZSBgd2VpZ2h0YCBhcmd1bWVudC4NCg0KPiBgQm9vdHN0cmFwIHNhbXBsZXNgIGFyZSBhIHNwZWNpYWwgc3RhdGlzdGljYWwgc2FtcGxpbmcgbWV0aG9kLiBDb3VudGVyaW50dWl0aXZlIHBlcmhhcHMsIHNpbmNlIHlvdSBzYW1wbGUgd2l0aCByZXBsYWNlbWVudC4gU2hvdWxkIHJlbWluZCB5b3Ugb2YgeW91ciBoaWdoIHNjaG9vbCBQZXJtdXRhdGlvbiBhbmQgQ29tYmluYXRpb24gY2xhc3MsIHdpdGggYWxsIHRob3NlIHVybiBtb2RlbHMgYW5kIHNvIG9uLiBJZiB5b3UgcmVtZW1iZXIuIA0KDQoqIGBzbGljZV9taW4oKWAgYW5kIGBzbGljZV9tYXgoKWAgc2VsZWN0IHJvd3Mgd2l0aCBoaWdoZXN0IG9yIGxvd2VzdCB2YWx1ZXMgb2YgYSB2YXJpYWJsZS4gTm90ZSB0aGF0IHdlIGZpcnN0IG11c3QgY2hvb3NlICBvbmx5IHRoZSB2YWx1ZXMgd2hpY2ggYXJlIG5vdCBOQS4NCg0KYGBge3J9DQpzdGFyd2FycyAlPiUNCiAgZmlsdGVyKCFpcy5uYShoZWlnaHQpKSAlPiUNCiAgc2xpY2VfbWluKGhlaWdodCwgbiA9IDMpDQpgYGANCg0KIyMjIFNlbGVjdCBjb2x1bW5zIHdpdGggYHNlbGVjdCgpYA0KDQpPZnRlbiB5b3Ugd29yayB3aXRoIGxhcmdlIGRhdGFzZXRzIHdpdGggbWFueSBjb2x1bW5zIGJ1dCBvbmx5IGEgZmV3IGFyZSBhY3R1YWxseSBvZiBpbnRlcmVzdCB0byB5b3UuIGBzZWxlY3QoKWAgYWxsb3dzIHlvdSB0byByYXBpZGx5IHpvb20gaW4gb24gYSB1c2VmdWwgc3Vic2V0IHVzaW5nIG9wZXJhdGlvbnMgdGhhdCB1c3VhbGx5IG9ubHkgd29yayBvbiBudW1lcmljIHZhcmlhYmxlIHBvc2l0aW9uczoNCg0KYGBge3J9DQojIFNlbGVjdCBjb2x1bW5zIGJ5IG5hbWUNCnN0YXJ3YXJzICU+JSBzZWxlY3QoaGFpcl9jb2xvciwgc2tpbl9jb2xvciwgZXllX2NvbG9yKQ0KIyBTZWxlY3QgYWxsIGNvbHVtbnMgYmV0d2VlbiBoYWlyX2NvbG9yIGFuZCBleWVfY29sb3IgKGluY2x1c2l2ZSkNCnN0YXJ3YXJzICU+JSBzZWxlY3QoaGFpcl9jb2xvcjpleWVfY29sb3IpDQojIFNlbGVjdCBhbGwgY29sdW1ucyBleGNlcHQgdGhvc2UgZnJvbSBoYWlyX2NvbG9yIHRvIGV5ZV9jb2xvciAoaW5jbHVzaXZlKQ0Kc3RhcndhcnMgJT4lIHNlbGVjdCghKGhhaXJfY29sb3I6ZXllX2NvbG9yKSkNCiMgU2VsZWN0IGFsbCBjb2x1bW5zIGVuZGluZyB3aXRoIGNvbG9yDQpzdGFyd2FycyAlPiUgc2VsZWN0KGVuZHNfd2l0aCgiY29sb3IiKSkNCmBgYA0KDQpUaGVyZSBhcmUgYSBudW1iZXIgb2YgaGVscGVyIGZ1bmN0aW9ucyB5b3UgY2FuIHVzZSB3aXRoaW4gYHNlbGVjdCgpYCwgbGlrZSBgc3RhcnRzX3dpdGgoKWAsIGBlbmRzX3dpdGgoKWAsIGBtYXRjaGVzKClgIGFuZCBgY29udGFpbnMoKWAuIFRoZXNlIGxldCB5b3UgcXVpY2tseSBtYXRjaCBsYXJnZXIgYmxvY2tzIG9mIHZhcmlhYmxlcyB0aGF0IG1lZXQgc29tZSBjcml0ZXJpb24uIFNlZSBgP3NlbGVjdGAgZm9yIG1vcmUgZGV0YWlscy4NCg0KWW91IGNhbiByZW5hbWUgdmFyaWFibGVzIHdpdGggYHNlbGVjdCgpYCBieSB1c2luZyBuYW1lZCBhcmd1bWVudHM6DQoNCmBgYHtyfQ0Kc3RhcndhcnMgJT4lIHNlbGVjdChob21lX3dvcmxkID0gaG9tZXdvcmxkKQ0KYGBgDQoNCkJ1dCBiZWNhdXNlIGBzZWxlY3QoKWAgZHJvcHMgYWxsIHRoZSB2YXJpYWJsZXMgbm90IGV4cGxpY2l0bHkgbWVudGlvbmVkLCBpdCdzIG5vdCB0aGF0IHVzZWZ1bC4gSW5zdGVhZCwgdXNlIGByZW5hbWUoKWA6DQoNCmBgYHtyfQ0Kc3RhcndhcnMgJT4lIHJlbmFtZShob21lX3dvcmxkID0gaG9tZXdvcmxkKQ0KYGBgDQoNCiMjIyBBZGQgbmV3IGNvbHVtbnMgd2l0aCBgbXV0YXRlKClgDQoNCkJlc2lkZXMgc2VsZWN0aW5nIHNldHMgb2YgZXhpc3RpbmcgY29sdW1ucywgaXQncyBvZnRlbiB1c2VmdWwgdG8gYWRkIG5ldyBjb2x1bW5zIHRoYXQgYXJlIGZ1bmN0aW9ucyBvZiBleGlzdGluZyBjb2x1bW5zLiBUaGlzIGlzIHRoZSBqb2Igb2YgYG11dGF0ZSgpYDoNCg0KYGBge3J9DQpzdGFyd2FycyAlPiUgbXV0YXRlKGhlaWdodF9tID0gaGVpZ2h0IC8gMTAwKQ0KYGBgDQoNCldlIGNhbid0IHNlZSB0aGUgaGVpZ2h0IGluIG1ldGVycyB3ZSBqdXN0IGNhbGN1bGF0ZWQsIGJ1dCB3ZSBjYW4gZml4IHRoYXQgdXNpbmcgYSBzZWxlY3QgY29tbWFuZC4NCg0KYGBge3J9DQpzdGFyd2FycyAlPiUNCiAgbXV0YXRlKGhlaWdodF9tID0gaGVpZ2h0IC8gMTAwKSAlPiUNCiAgc2VsZWN0KGhlaWdodF9tLCBoZWlnaHQsIGV2ZXJ5dGhpbmcoKSkNCmBgYA0KDQpgZHBseXI6Om11dGF0ZSgpYCBpcyBzaW1pbGFyIHRvIHRoZSBiYXNlIGB0cmFuc2Zvcm0oKWAsIGJ1dCBhbGxvd3MgeW91IHRvIHJlZmVyIHRvIGNvbHVtbnMgdGhhdCB5b3UndmUganVzdCBjcmVhdGVkOg0KDQpgYGB7cn0NCnN0YXJ3YXJzICU+JQ0KICBtdXRhdGUoDQogICAgaGVpZ2h0X20gPSBoZWlnaHQgLyAxMDAsDQogICAgQk1JID0gbWFzcyAvIChoZWlnaHRfbV4yKQ0KICApICU+JQ0KICBzZWxlY3QoQk1JLCBldmVyeXRoaW5nKCkpDQpgYGANCg0KSWYgeW91IG9ubHkgd2FudCB0byBrZWVwIHRoZSBuZXcgdmFyaWFibGVzLCB1c2UgYHRyYW5zbXV0ZSgpYDoNCg0KYGBge3J9DQpzdGFyd2FycyAlPiUNCiAgdHJhbnNtdXRlKA0KICAgIGhlaWdodF9tID0gaGVpZ2h0IC8gMTAwLA0KICAgIEJNSSA9IG1hc3MgLyAoaGVpZ2h0X21eMikNCiAgKQ0KYGBgDQoNCiMjIyBDaGFuZ2UgY29sdW1uIG9yZGVyIHdpdGggYHJlbG9jYXRlKClgDQoNClVzZSBhIHNpbWlsYXIgc3ludGF4IGFzIGBzZWxlY3QoKWAgdG8gbW92ZSBibG9ja3Mgb2YgY29sdW1ucyBhdCBvbmNlDQoNCmBgYHtyfQ0Kc3RhcndhcnMgJT4lIHJlbG9jYXRlKHNleDpob21ld29ybGQsIC5iZWZvcmUgPSBoZWlnaHQpDQpgYGANCg0KDQojIyMgU3VtbWFyaXNlIHZhbHVlcyB3aXRoIGBzdW1tYXJpc2UoKWANCg0KVGhlIGxhc3QgdmVyYiBpcyBgc3VtbWFyaXNlKClgLiBJdCBjb2xsYXBzZXMgYSBkYXRhIGZyYW1lIHRvIGEgc2luZ2xlIHJvdy4NCg0KYGBge3J9DQpzdGFyd2FycyAlPiUgc3VtbWFyaXNlKG1lYW5faGVpZ2h0ID0gbWVhbihoZWlnaHQsIG5hLnJtID0gVFJVRSkpDQpgYGANCg0KSXQncyBub3QgdGhhdCB1c2VmdWwgdW50aWwgd2UgbGVhcm4gdGhlIGBncm91cF9ieSgpYCB2ZXJiIGJlbG93Lg0KDQoNCiMjIyBDb21tb25hbGl0aWVzDQoNCllvdSBtYXkgaGF2ZSBub3RpY2VkIHRoYXQgdGhlIHN5bnRheCBhbmQgZnVuY3Rpb24gb2YgYWxsIHRoZXNlIHZlcmJzIGFyZSB2ZXJ5IHNpbWlsYXI6DQoNCiogVGhlIGZpcnN0IGFyZ3VtZW50IGlzIGEgZGF0YSBmcmFtZS4NCg0KKiBUaGUgc3Vic2VxdWVudCBhcmd1bWVudHMgZGVzY3JpYmUgd2hhdCB0byBkbyB3aXRoIHRoZSBkYXRhIGZyYW1lLiBZb3UgY2FuDQogIHJlZmVyIHRvIGNvbHVtbnMgaW4gdGhlIGRhdGEgZnJhbWUgZGlyZWN0bHkgd2l0aG91dCB1c2luZyBgJGAuDQoNCiogVGhlIHJlc3VsdCBpcyBhIG5ldyBkYXRhIGZyYW1lDQoNClRvZ2V0aGVyIHRoZXNlIHByb3BlcnRpZXMgbWFrZSBpdCBlYXN5IHRvIGNoYWluIHRvZ2V0aGVyIG11bHRpcGxlIHNpbXBsZSBzdGVwcyB0byBhY2hpZXZlIGEgY29tcGxleCByZXN1bHQuIA0KDQpUaGVzZSBmaXZlIGZ1bmN0aW9ucyBwcm92aWRlIHRoZSBiYXNpcyBvZiBhIGxhbmd1YWdlIG9mIGRhdGEgbWFuaXB1bGF0aW9uLiBBdCB0aGUgbW9zdCBiYXNpYyBsZXZlbCwgeW91IGNhbiBvbmx5IGFsdGVyIGEgdGlkeSBkYXRhIGZyYW1lIGluIGZpdmUgdXNlZnVsIHdheXM6IHlvdSBjYW4gcmVvcmRlciB0aGUgcm93cyAoYGFycmFuZ2UoKWApLCBwaWNrIG9ic2VydmF0aW9ucyBhbmQgdmFyaWFibGVzIG9mIGludGVyZXN0IChgZmlsdGVyKClgIGFuZCBgc2VsZWN0KClgKSwgYWRkIG5ldyB2YXJpYWJsZXMgdGhhdCBhcmUgZnVuY3Rpb25zIG9mIGV4aXN0aW5nIHZhcmlhYmxlcyAoYG11dGF0ZSgpYCksIG9yIGNvbGxhcHNlIG1hbnkgdmFsdWVzIHRvIGEgc3VtbWFyeSAoYHN1bW1hcmlzZSgpYCkuIA0KDQojIyBDb21iaW5pbmcgZnVuY3Rpb25zIHdpdGggYCU+JWAgDQoNClRoZSBkcGx5ciBBUEkgaXMgZnVuY3Rpb25hbCBpbiB0aGUgc2Vuc2UgdGhhdCBmdW5jdGlvbiBjYWxscyBkb24ndCBoYXZlIHNpZGUtZWZmZWN0cy4gWW91IG11c3QgYWx3YXlzIHNhdmUgdGhlaXIgcmVzdWx0cy4gVGhpcyBkb2Vzbid0IGxlYWQgdG8gcGFydGljdWxhcmx5IGVsZWdhbnQgY29kZSwgZXNwZWNpYWxseSBpZiB5b3Ugd2FudCB0byBkbyBtYW55IG9wZXJhdGlvbnMgYXQgb25jZS4gWW91IGVpdGhlciBoYXZlIHRvIGRvIGl0IHN0ZXAtYnktc3RlcDoNCg0KYGBge3IsIGV2YWwgPSBGQUxTRX0NCmExIDwtIGdyb3VwX2J5KHN0YXJ3YXJzLCBzcGVjaWVzLCBzZXgpDQphMiA8LSBzZWxlY3QoYTEsIGhlaWdodCwgbWFzcykNCmEzIDwtIHN1bW1hcmlzZShhMiwNCiAgaGVpZ2h0ID0gbWVhbihoZWlnaHQsIG5hLnJtID0gVFJVRSksDQogIG1hc3MgPSBtZWFuKG1hc3MsIG5hLnJtID0gVFJVRSkNCikNCmBgYA0KDQpPciBpZiB5b3UgZG9uJ3Qgd2FudCB0byBuYW1lIHRoZSBpbnRlcm1lZGlhdGUgcmVzdWx0cywgeW91IG5lZWQgdG8gd3JhcCB0aGUgZnVuY3Rpb24gY2FsbHMgaW5zaWRlIGVhY2ggb3RoZXI6DQoNCmBgYHtyfQ0Kc3VtbWFyaXNlKA0KICBzZWxlY3QoDQogICAgZ3JvdXBfYnkoc3RhcndhcnMsIHNwZWNpZXMsIHNleCksDQogICAgaGVpZ2h0LCBtYXNzDQogICksDQogIGhlaWdodCA9IG1lYW4oaGVpZ2h0LCBuYS5ybSA9IFRSVUUpLA0KICBtYXNzID0gbWVhbihtYXNzLCBuYS5ybSA9IFRSVUUpDQopDQpgYGANCg0KVGhpcyBpcyBkaWZmaWN1bHQgdG8gcmVhZCBiZWNhdXNlIHRoZSBvcmRlciBvZiB0aGUgb3BlcmF0aW9ucyBpcyBmcm9tIGluc2lkZSB0byBvdXQuIFRodXMsIHRoZSBhcmd1bWVudHMgYXJlIGEgbG9uZyB3YXkgYXdheSBmcm9tIHRoZSBmdW5jdGlvbi4gVG8gZ2V0IGFyb3VuZCB0aGlzIHByb2JsZW0sIGRwbHlyIHByb3ZpZGVzIHRoZSBgJT4lYCBvcGVyYXRvciBmcm9tIG1hZ3JpdHRyLiBgeCAlPiUgZih5KWAgdHVybnMgaW50byBgZih4LCB5KWAgc28geW91IGNhbiB1c2UgaXQgdG8gcmV3cml0ZSBtdWx0aXBsZSBvcGVyYXRpb25zIHRoYXQgeW91IGNhbiByZWFkIGxlZnQtdG8tcmlnaHQsIHRvcC10by1ib3R0b20gKHJlYWRpbmcgdGhlIHBpcGUgb3BlcmF0b3IgYXMgInRoZW4iKToNCg0KYGBge3J9DQpzdGFyd2FycyAlPiUNCiAgZ3JvdXBfYnkoc3BlY2llcywgc2V4KSAlPiUNCiAgc3VtbWFyaXNlKA0KICAgIG1lYW5faGVpZ2h0ID0gbWVhbihoZWlnaHQsIG5hLnJtID0gVFJVRSksDQogICAgbWVhbl9tYXNzID0gbWVhbihtYXNzLCBuYS5ybSA9IFRSVUUpDQogICkNCmBgYA0KDQojIyBQYXR0ZXJucyBvZiBvcGVyYXRpb25zDQoNClRoZSBkcGx5ciB2ZXJicyBjYW4gYmUgY2xhc3NpZmllZCBieSB0aGUgdHlwZSBvZiBvcGVyYXRpb25zIHRoZXkgYWNjb21wbGlzaCAod2Ugc29tZXRpbWVzIHNwZWFrIG9mIHRoZWlyICoqc2VtYW50aWNzKiosIGkuZS4sIHRoZWlyIG1lYW5pbmcpLiBJdCdzIGhlbHBmdWwgdG8gaGF2ZSBhIGdvb2QgZ3Jhc3Agb2YgdGhlIGRpZmZlcmVuY2UgYmV0d2VlbiBzZWxlY3QgYW5kIG11dGF0ZSBvcGVyYXRpb25zLg0KDQojIyMgU2VsZWN0aW5nIG9wZXJhdGlvbnMNCg0KT25lIG9mIHRoZSBhcHBlYWxpbmcgZmVhdHVyZXMgb2YgZHBseXIgaXMgdGhhdCB5b3UgY2FuIHJlZmVyIHRvIGNvbHVtbnMgZnJvbSB0aGUgdGliYmxlIGFzIGlmIHRoZXkgd2VyZSByZWd1bGFyIHZhcmlhYmxlcy4gSG93ZXZlciwgdGhlIHN5bnRhY3RpYyB1bmlmb3JtaXR5IG9mIHJlZmVycmluZyB0byBiYXJlIGNvbHVtbiBuYW1lcyBoaWRlcyBzZW1hbnRpY2FsIGRpZmZlcmVuY2VzIGFjcm9zcyB0aGUgdmVyYnMuIEEgY29sdW1uIHN5bWJvbCBzdXBwbGllZCB0byBgc2VsZWN0KClgIGRvZXMgbm90IGhhdmUgdGhlIHNhbWUgbWVhbmluZyBhcyB0aGUgc2FtZSBzeW1ib2wgc3VwcGxpZWQgdG8gYG11dGF0ZSgpYC4NCg0KU2VsZWN0aW5nIG9wZXJhdGlvbnMgZXhwZWN0IGNvbHVtbiBuYW1lcyBhbmQgcG9zaXRpb25zLiBIZW5jZSwgd2hlbiB5b3UgY2FsbCBgc2VsZWN0KClgIHdpdGggYmFyZSB2YXJpYWJsZSBuYW1lcywgdGhleSBhY3R1YWxseSByZXByZXNlbnQgdGhlaXIgb3duIHBvc2l0aW9ucyBpbiB0aGUgdGliYmxlLiBUaGUgZm9sbG93aW5nIGNhbGxzIGFyZSBjb21wbGV0ZWx5IGVxdWl2YWxlbnQgZnJvbSBkcGx5cidzIHBvaW50IG9mIHZpZXc6DQoNCmBgYHtyfQ0KIyBgbmFtZWAgcmVwcmVzZW50cyB0aGUgaW50ZWdlciAxDQpzZWxlY3Qoc3RhcndhcnMsIG5hbWUpDQpzZWxlY3Qoc3RhcndhcnMsIDEpDQpgYGANCg0KQnkgdGhlIHNhbWUgdG9rZW4sIHRoaXMgbWVhbnMgdGhhdCB5b3UgY2Fubm90IHJlZmVyIHRvIHZhcmlhYmxlcyBmcm9tIHRoZSBzdXJyb3VuZGluZyBjb250ZXh0IGlmIHRoZXkgaGF2ZSB0aGUgc2FtZSBuYW1lIGFzIG9uZSBvZiB0aGUgY29sdW1ucy4gSW4gdGhlIGZvbGxvd2luZyBleGFtcGxlLCBgaGVpZ2h0YCBzdGlsbCByZXByZXNlbnRzIDIsIG5vdCA1Og0KDQpgYGB7cn0NCmhlaWdodCA8LSA1DQpzZWxlY3Qoc3RhcndhcnMsIGhlaWdodCkNCmBgYA0KDQpPbmUgdXNlZnVsIHN1YnRsZXR5IGlzIHRoYXQgdGhpcyBvbmx5IGFwcGxpZXMgdG8gYmFyZSBuYW1lcyBhbmQgdG8gc2VsZWN0aW5nIGNhbGxzIGxpa2UgYGMoaGVpZ2h0LCBtYXNzKWAgb3IgYGhlaWdodDptYXNzYC4gSW4gYWxsIG90aGVyIGNhc2VzLCB0aGUgY29sdW1ucyBvZiB0aGUgZGF0YSBmcmFtZSBhcmUgbm90IHB1dCBpbiBzY29wZS4gVGhpcyBhbGxvd3MgeW91IHRvIHJlZmVyIHRvIGNvbnRleHR1YWwgdmFyaWFibGVzIGluIHNlbGVjdGlvbiBoZWxwZXJzOg0KDQpgYGB7cn0NCm5hbWUgPC0gImNvbG9yIg0Kc2VsZWN0KHN0YXJ3YXJzLCBlbmRzX3dpdGgobmFtZSkpDQpgYGANCg0KVGhlc2Ugc2VtYW50aWNzIGFyZSB1c3VhbGx5IGludHVpdGl2ZS4gQnV0IG5vdGUgdGhlIHN1YnRsZSBkaWZmZXJlbmNlOg0KDQpgYGB7cn0NCm5hbWUgPC0gNQ0Kc2VsZWN0KHN0YXJ3YXJzLCBuYW1lLCBpZGVudGl0eShuYW1lKSkNCmBgYA0KDQpJbiB0aGUgZmlyc3QgYXJndW1lbnQsIGBuYW1lYCByZXByZXNlbnRzIGl0cyBvd24gcG9zaXRpb24gYDFgLiBJbiB0aGUgc2Vjb25kIGFyZ3VtZW50LCBgbmFtZWAgaXMgZXZhbHVhdGVkIGluIHRoZSBzdXJyb3VuZGluZyBjb250ZXh0IGFuZCByZXByZXNlbnRzIHRoZSBmaWZ0aCBjb2x1bW4uDQoNCg0KIyMjIE11dGF0aW5nIG9wZXJhdGlvbnMNCg0KTXV0YXRlIHNlbWFudGljcyBhcmUgcXVpdGUgZGlmZmVyZW50IGZyb20gc2VsZWN0aW9uIHNlbWFudGljcy4gV2hlcmVhcyBgc2VsZWN0KClgIGV4cGVjdHMgY29sdW1uIG5hbWVzIG9yIHBvc2l0aW9ucywgYG11dGF0ZSgpYCBleHBlY3RzICpjb2x1bW4gdmVjdG9ycyouICBXZSB3aWxsIHNldCB1cCBhIHNtYWxsZXIgdGliYmxlIHRvIHVzZSBmb3Igb3VyIGV4YW1wbGVzLg0KDQpgYGB7cn0NCmRmIDwtIHN0YXJ3YXJzICU+JSBzZWxlY3QobmFtZSwgaGVpZ2h0LCBtYXNzKQ0KYGBgDQoNCldoZW4gd2UgdXNlIGBzZWxlY3QoKWAsIHRoZSBiYXJlIGNvbHVtbiBuYW1lcyBzdGFuZCBmb3IgdGhlaXIgb3duIHBvc2l0aW9ucyBpbiB0aGUgdGliYmxlLiBGb3IgYG11dGF0ZSgpYCBvbiB0aGUgb3RoZXIgaGFuZCwgY29sdW1uIHN5bWJvbHMgcmVwcmVzZW50IHRoZSBhY3R1YWwgY29sdW1uIHZlY3RvcnMgc3RvcmVkIGluIHRoZSB0aWJibGUuIENvbnNpZGVyIHdoYXQgaGFwcGVucyBpZiB3ZSBnaXZlIGEgc3RyaW5nIG9yIGEgbnVtYmVyIHRvIGBtdXRhdGUoKWA6DQoNCmBgYHtyfQ0KbXV0YXRlKGRmLCAiaGVpZ2h0IiwgMikNCmBgYA0KDQpgbXV0YXRlKClgIGdldHMgbGVuZ3RoLTEgdmVjdG9ycyB0aGF0IGl0IGludGVycHJldHMgYXMgbmV3IGNvbHVtbnMgaW4gdGhlIGRhdGEgZnJhbWUuIFRoZXNlIHZlY3RvcnMgYXJlIHJlY3ljbGVkIHNvIHRoZXkgbWF0Y2ggdGhlIG51bWJlciBvZiByb3dzLiBUaGF0J3Mgd2h5IGl0IGRvZXNuJ3QgbWFrZSBzZW5zZSB0byBzdXBwbHkgZXhwcmVzc2lvbnMgbGlrZSBgImhlaWdodCIgKyAxMGAgdG8gYG11dGF0ZSgpYC4gVGhpcyBhbW91bnRzIHRvIGFkZGluZyAxMCB0byBhIHN0cmluZyENClRoZSBjb3JyZWN0IGV4cHJlc3Npb24gaXM6DQoNCmBgYHtyfQ0KbXV0YXRlKGRmLCBoZWlnaHQgKyAxMCkNCmBgYA0KDQpJbiB0aGUgc2FtZSB3YXksIHlvdSBjYW4gdW5xdW90ZSB2YWx1ZXMgZnJvbSB0aGUgY29udGV4dCBpZiB0aGVzZSB2YWx1ZXMgcmVwcmVzZW50IGEgdmFsaWQgY29sdW1uLiBUaGV5IG11c3QgYmUgZWl0aGVyIGxlbmd0aCAxICh0aGV5IHRoZW4gZ2V0IHJlY3ljbGVkKSBvciBoYXZlIHRoZSBzYW1lIGxlbmd0aCBhcyB0aGUgbnVtYmVyIG9mIHJvd3MuIEluIHRoZSBmb2xsb3dpbmcgZXhhbXBsZSB3ZSBjcmVhdGUgYSBuZXcgdmVjdG9yIHRoYXQgd2UgYWRkIHRvIHRoZSBkYXRhIGZyYW1lOg0KDQpgYGB7cn0NCnZhciA8LSBzZXEoMSwgbnJvdyhkZikpDQptdXRhdGUoZGYsIG5ldyA9IHZhcikNCmBgYA0KDQpBIGNhc2UgaW4gcG9pbnQgaXMgYGdyb3VwX2J5KClgLiBXaGlsZSB5b3UgbWlnaHQgdGhpbmsgaXQgaGFzIGBzZWxlY3RgIHNlbWFudGljcywgaXQgYWN0dWFsbHkgaGFzIGBtdXRhdGVgIHNlbWFudGljcy4gVGhpcyBpcyBxdWl0ZSBoYW5keSBhcyBpdCBhbGxvd3MgdG8gZ3JvdXAgYnkgYSBtb2RpZmllZCBjb2x1bW46DQoNCmBgYHtyfQ0KZ3JvdXBfYnkoc3RhcndhcnMsIHNleCkNCmdyb3VwX2J5KHN0YXJ3YXJzLCBzZXggPSBhcy5mYWN0b3Ioc2V4KSkNCmdyb3VwX2J5KHN0YXJ3YXJzLCBoZWlnaHRfYmlubmVkID0gY3V0KGhlaWdodCwgMykpDQpgYGANCg0KVGhpcyBpcyB3aHkgeW91IGNhbid0IHN1cHBseSBhIGNvbHVtbiBuYW1lIHRvIGBncm91cF9ieSgpYC4gVGhpcyBhbW91bnRzIHRvIGNyZWF0aW5nIGEgbmV3IGNvbHVtbiBjb250YWluaW5nIHRoZSBzdHJpbmcgcmVjeWNsZWQgdG8gdGhlIG51bWJlciBvZiByb3dzOg0KDQpgYGB7cn0NCmdyb3VwX2J5KGRmLCAibW9udGgiKQ0KYGBgDQoNCg0KIyMgVHdvIHRhYmxlIHZlcmJzDQoNClNvbWV0aW1lcyBvdXIgZGF0YSBpcyBzcHJlYWQgYWNyb3NzIG1vcmUgdGhhbiBvbmUgdGFibGUuIE9mdGVuIHRoZXNlIHRhYmxlcyBhcmUgKmxpbmtlZCogYnkgc29tZSBjb21tb24sIG9yIGNvbW1vbi1sb29raW5nLCB2YXJpYWJsZSBjb2x1bW5zLiBgZHBseXJgIGFsbG93cyB1cyB0byB3b3JrIHdpdGggc3VjaCBkYXRhIHRoYXQgaXMgc3ByZWFkIG92ZXIgbW9yZSB0aGFuIG9uZSB0YWJsZS4gDQpNb3JlIGluZm9ybWF0aW9uIGlzIGF2YWlsYWJsZSBoZXJlOiBbVHdvIFRhYmxlIFZlcmJzIGluIGRwbHlyXShodHRwczovL2NyYW4uci1wcm9qZWN0Lm9yZy93ZWIvcGFja2FnZXMvZHBseXIvdmlnbmV0dGVzL3R3by10YWJsZS5odG1sKQ0KDQpUaGUgb3BlcmF0aW9ucy92ZXJicyB1c2VkIHRvIG1hbmlwdWxhdGUgdHdvLXRhYmxlIHZlcmJzIGFyZToNCg0KKiBNdXRhdGluZyBqb2lucywgd2hpY2ggYWRkIG5ldyB2YXJpYWJsZXMgdG8gb25lIHRhYmxlIGZyb20gbWF0Y2hpbmcgcm93cyBpbiBhbm90aGVyLg0KICAtIGBpbm5lcl9qb2luKClgDQogIA0KYGBge3IsZWNobz1GQUxTRX0NCmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCJpbWFnZXMvaW5uZXItam9pbi5naWYiKQ0KYGBgDQoNCiAgLSBgbGVmdF9qb2luKClgDQogIA0KYGBge3IsZWNobz1GQUxTRX0NCmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCJpbWFnZXMvbGVmdC1qb2luLmdpZiIpDQpgYGANCg0KICAtIGByaWdodF9qb2luKClgDQogIA0KYGBge3IsZWNobz1GQUxTRX0NCmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCJpbWFnZXMvcmlnaHQtam9pbi5naWYiKQ0KYGBgDQoNCg0KICAtIGBmdWxsX2pvaW4oKWANCiAgICANCmBgYHtyLGVjaG89RkFMU0V9DQprbml0cjo6aW5jbHVkZV9ncmFwaGljcygiaW1hZ2VzL2Z1bGwtam9pbi5naWYiKQ0KYGBgDQoNCiAgDQoqIEZpbHRlcmluZyBqb2lucywgd2hpY2ggZmlsdGVyIG9ic2VydmF0aW9ucyBmcm9tIG9uZSB0YWJsZSBiYXNlZCBvbiB3aGV0aGVyIG9yIG5vdCB0aGV5IG1hdGNoIGFuIG9ic2VydmF0aW9uIGluIHRoZSBvdGhlciB0YWJsZS4NCiAgLSBgc2VtaV9qb2luKHgsIHkpYCBrZWVwcyBhbGwgb2JzZXJ2YXRpb25zIGluIHggdGhhdCBoYXZlIGEgbWF0Y2ggaW4geS4NCiAgDQpgYGB7cixlY2hvPUZBTFNFfQ0Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoImltYWdlcy9zZW1pLWpvaW4uZ2lmIikNCmBgYA0KDQoNCiAgLSBgYW50aV9qb2luKHgsIHkpYCBkcm9wcyBhbGwgb2JzZXJ2YXRpb25zIGluIHggdGhhdCBoYXZlIGEgbWF0Y2ggaW4geS4NCiAgDQpgYGB7cixlY2hvPUZBTFNFfQ0Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoImltYWdlcy9hbnRpLWpvaW4uZ2lmIikNCmBgYA0KDQoNCg0KDQoqIFNldCBvcGVyYXRpb25zLCB3aGljaCBjb21iaW5lIHRoZSBvYnNlcnZhdGlvbnMgaW4gdGhlIGRhdGEgc2V0cyBhcyBpZiB0aGV5IHdlcmUgc2V0IGVsZW1lbnRzLg0KDQogIC0gdW5pb24oKQ0KICANCmBgYHtyLGVjaG89RkFMU0V9DQprbml0cjo6aW5jbHVkZV9ncmFwaGljcygiaW1hZ2VzL3VuaW9uLmdpZi4iKQ0KYGBgDQoNCiAgLSB1bmlvbl9hbGwoKSwgDQogIA0KYGBge3IsZWNobz1GQUxTRX0NCmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCJpbWFnZXMvdW5pb24tYWxsLmdpZi4iKQ0KYGBgDQoNCiAgLSBpbnRlcnNlY3QoKSwgDQogIA0KYGBge3IsZWNobz1GQUxTRX0NCmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCJpbWFnZXMvaW50ZXJzZWN0LmdpZiIpDQpgYGANCiAgDQogIC0gc2V0ZGlmZigpDQogIA0KYGBge3IsZWNobz1GQUxTRX0NCmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCJpbWFnZXMvc2V0ZGlmZi1yZXYuZ2lmIikNCmBgYA0KDQoqIFRpZHlyIE9wZXJhdGlvbnM6IA0KLSBwaXZvdF9sb25nZXIoKQ0KLSBwaXZvdF93aWRlcigpDQogIA0KYGBge3IsZWNobz1GQUxTRX0NCmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKCJpbWFnZXMvdGlkeXItcGl2b3RpbmcuZ2lmIikNCmBgYA0KDQo=